The value of referral information and assessment - a cross sectional study of radiographers' perceptions.

BACKGROUND: Radiology professionals are frequently confronted with referrals containing insufficient clinical information, which hinders delivery of safe and quality medical imaging services. There is however lack of knowledge on why and how referral information is important for radiographers in clinical practice. This study explores what purposes referral information is used/ useful for the radiographers, and the benefits of involving them in assessing referrals. METHODS: A cross sectional study was conducted of radiographers recruited through the International Society of Radiographers and Radiological Technologists (ISRRT) networks. A questionnaire was developed and distributed consisting of 5-point Likert scale questions on a) use/usefulness of referral information for 12 listed purposes and b) the benefits of radiographers assessing referrals for 8 possible reasons. The questionnaire was validated using a test-retest reliability analysis. Kappa values ≥0.6 were accepted. SPSS software was used for data analysis and chi-square tests to determine associations between using referral information and background variables. RESULTS: Total respondents were 279 (n = 233 currently in clinical practice and n = 46 in other positions). The participants in clinical practice ranked high all 12 listed purposes for use of referral information, and all except one received ≥60% 'frequent'/'very frequent' responses. Use for patient identification purposes received the highest score (97% 'frequently'/'very frequently' responses), followed by ensuring imaging of the correct body region (79% 'very frequently' responses). Radiographers not currently working in clinical practice ranked the 'usefulness' of listed items similarly. Significant associations between frequent use of referral information and education level were not observed, and only three items were significantly associated with modality of practice. All items on benefits of radiographers assessing referrals received ≥75% 'agree'/'strongly agree' scores. The items ranked highest were promotes radiographers' professional responsibility and improves collaboration with radiologists and referring clinicians, with 72 and 67% strongly agreed responses, respectively. CONCLUSION: Radiographers use referral information frequently for several purposes. The referral information is needed for justifying and optimising radiological procedures, hence crucial for ensuring patient safety and high-quality services. This further emphasis why radiographers perceive several benefits of being involved in assessing the referral information.

Methods Assessing Sociocultural Aspects of Health Technologies: Results of a Literature Review.

OBJECTIVES: Social and cultural aspects are rarely assessed in health technology assessments (HTA), despite being part of most HTA definitions. One hypothesis for the reason why they are hardly considered in HTA is that we lack relevant assessment methods. Accordingly, this review aims at providing an overview of methodological approaches to address social and cultural aspects related to health technologies in HTA. METHODS: We conducted a comprehensive literature search by searching fourteen databases and a hand-search of two pertinent journals. Additionally, we sent a query to all member agencies of the International Network of Agencies for Health Technology Assessment (INAHTA) asking them for methods they use to assess social and cultural aspects. RESULTS: A total of 125 publications met our inclusion criteria. We grouped the methodological approaches into checklists for experts, literature reviews, stakeholder participatory approaches, primary data collection methods, and combinations of methodological approaches. CONCLUSIONS: There is a wide variety of methods available for assessing social and cultural aspects of health technologies, some of which have been applied in HTA. The presented overview of the different approaches and their merits can facilitate the assessment of these aspects, and improve the knowledge regarding (potential) success and failure of the implementation of a health technology.

STAKEHOLDER INVOLVEMENT THROUGHOUT HEALTH TECHNOLOGY ASSESSMENT: AN EXAMPLE FROM PALLIATIVE CARE.

OBJECTIVES: Internationally, funders require stakeholder involvement throughout health technology assessment (HTA). We report successes, challenges, and lessons learned from extensive stakeholder involvement throughout a palliative care case study that demonstrates new concepts and methods for HTA. METHODS: A 5-step "INTEGRATE-HTA Model" developed within the INTEGRATE-HTA project guided the case study. Using convenience or purposive sampling or directly / indirectly identifying and approaching individuals / groups, stakeholders participated in qualitative research or consultation meetings. During scoping, 132 stakeholders, aged ≥ 18 years in seven countries (England, Italy, Germany, The Netherlands, Norway, Lithuania, and Poland), highlighted key issues in palliative care that assisted identification of the intervention and comparator. Subsequently stakeholders in four countries participated in face-face, telephone and / or video Skype meetings to inform evidence collection and / or review assessment results. An applicability assessment to identify contextual and implementation barriers and enablers for the case study findings involved twelve professionals in the three countries. Finally, thirteen stakeholders participated in a mock decision-making meeting in England. RESULTS: Views about the best methods of stakeholder involvement vary internationally. Stakeholders make valuable contributions in all stages of HTA; assisting decision making about interventions, comparators, research questions; providing evidence and insights into findings, gap analyses and applicability assessments. Key challenges exist regarding inclusivity, time, and resource use. CONCLUSION: Stakeholder involvement is feasible and worthwhile throughout HTA, sometimes providing unique insights. Various methods can be used to include stakeholders, although challenges exist. Recognition of stakeholder expertise and further guidance about stakeholder consultation methods is needed.

COMPREHENSIVE ASSESSMENT OF COMPLEX TECHNOLOGIES: INTEGRATING VARIOUS ASPECTS IN HEALTH TECHNOLOGY ASSESSMENT.

OBJECTIVES: Despite recent development of health technology assessment (HTA) methods, there are still methodological gaps for the assessment of complex health technologies. The INTEGRATE-HTA guidance for effectiveness, economic, ethical, socio-cultural, and legal aspects, deals with challenges when assessing complex technologies, such as heterogeneous study designs, multiple stakeholder perspectives, and unpredictable outcomes. The objective of this article is to outline this guidance and describe the added value of integrating these assessment aspects. METHODS: Different methods were used to develop the various parts of the guidance, but all draw on existing, published knowledge and were supported by stakeholder involvement. The guidance was modified after application in a case study and in response to feedback from internal and external reviewers. RESULTS: The guidance consists of five parts, addressing five core aspects of HTA, all presenting stepwise approaches based on the assessment of complexity, context, and stakeholder involvement. The guidance on effectiveness, health economics and ethics aspects focus on helping users choose appropriate, or further develop, existing methods. The recommendations are based on existing methods' applicability for dealing with problems arising with complex interventions. The guidance offers new frameworks to identify socio-cultural and legal issues, along with overviews of relevant methods and sources. CONCLUSIONS: The INTEGRATE-HTA guidance outlines a wide range of methods and facilitates appropriate choices among them. The guidance enables understanding of how complexity matters for HTA and brings together assessments from disciplines, such as epidemiology, economics, ethics, law, and social theory. This indicates relevance for a broad range of technologies.

Mobile radiography services in nursing homes: a systematic review of residents' and societal outcomes.

BACKGROUND: Demographic changes are leading to an ageing population in Europe, and predict an increase in the number of nursing home residents over the next 30 years. Nursing home residents need specialised healthcare services such as radiology due to both chronic and acute illnesses. Mobile radiography, x-ray examinations performed in the nursing homes, may be a good way of providing services to this population. The aim of this systematic review was to identify the outcomes of mobile radiography services for nursing home residents and society. METHODS: A systematic review based on searches in the Medline, Cochrane, PubMed, Embase and Svemed + databases was performed. Titles and abstracts were screened according to a predefined set of inclusion criteria: empirical studies in the geriatric population, and reports of mobile radiography services in a clinical setting. All publications were quality appraised using MMAT or CASP appraisal tools. Data were extracted using a summary table and results were narratively synthesised. RESULTS: Ten publications were included. Three overarching outcomes were identified: 1) reduced number of hospitalisations and outpatient examinations or treatments, 2) reduced number of transfers between nursing homes and hospitals and 3) increased access to x-ray examinations. These outcomes were interlinked with the more specific outcomes for residents and society reported in the literature. For residents there was a reduction in burdensome transfers and waiting time and adequate treatment and care increased. For society, released resources could be used more efficiently, and overall costs were reduced substantially. CONCLUSIONS: This review indicates that mobile radiography services for nursing home residents in the western world are of comparable quality to hospital-based examinations and have clear potential benefits. Mobile radiography reduced transfers to and from hospital, increased the number of examinations carried out and facilitated timely diagnosis and access to treatments. Further research is needed to formally evaluate potential improvements in care quality and cost-effectiveness.

Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework.

BACKGROUND: The effectiveness of complex interventions, as well as their success in reaching relevant populations, is critically influenced by their implementation in a given context. Current conceptual frameworks often fail to address context and implementation in an integrated way and, where addressed, they tend to focus on organisational context and are mostly concerned with specific health fields. Our objective was to develop a framework to facilitate the structured and comprehensive conceptualisation and assessment of context and implementation of complex interventions. METHODS: The Context and Implementation of Complex Interventions (CICI) framework was developed in an iterative manner and underwent extensive application. An initial framework based on a scoping review was tested in rapid assessments, revealing inconsistencies with respect to the underlying concepts. Thus, pragmatic utility concept analysis was undertaken to advance the concepts of context and implementation. Based on these findings, the framework was revised and applied in several systematic reviews, one health technology assessment (HTA) and one applicability assessment of very different complex interventions. Lessons learnt from these applications and from peer review were incorporated, resulting in the CICI framework. RESULTS: The CICI framework comprises three dimensions-context, implementation and setting-which interact with one another and with the intervention dimension. Context comprises seven domains (i.e., geographical, epidemiological, socio-cultural, socio-economic, ethical, legal, political); implementation consists of five domains (i.e., implementation theory, process, strategies, agents and outcomes); setting refers to the specific physical location, in which the intervention is put into practise. The intervention and the way it is implemented in a given setting and context can occur on a micro, meso and macro level. Tools to operationalise the framework comprise a checklist, data extraction tools for qualitative and quantitative reviews and a consultation guide for applicability assessments. CONCLUSIONS: The CICI framework addresses and graphically presents context, implementation and setting in an integrated way. It aims at simplifying and structuring complexity in order to advance our understanding of whether and how interventions work. The framework can be applied in systematic reviews and HTA as well as primary research and facilitate communication among teams of researchers and with various stakeholders.

Lay and professional stakeholder involvement in scoping palliative care issues: Methods used in seven European countries.

BACKGROUND: Stakeholders are people with an interest in a topic. Internationally, stakeholder involvement in palliative care research and health technology assessment requires development. Stakeholder involvement adds value throughout research (from prioritising topics to disseminating findings). Philosophies and understandings about the best ways to involve stakeholders in research differ internationally. Stakeholder involvement took place in seven countries (England, Germany, Italy, Lithuania, the Netherlands, Norway and Poland). Findings informed a project that developed concepts and methods for health technology assessment and applied these to evaluate models of palliative care service delivery. AIMS: To report on stakeholder involvement in the INTEGRATE-HTA project and how issues identified informed project development. DESIGN: Using stakeholder consultation or a qualitative research design, as appropriate locally, stakeholders in seven countries acted as 'advisors' to aid researchers' decision making. Thematic analysis was used to identify key issues across countries. SETTING/PARTICIPANTS: A total of 132 stakeholders (82 professionals and 50 'lay' people) aged ⩾18 participated in individual face-to-face or telephone interviews, consultation meetings or focus groups. RESULTS: Different stakeholder involvement methods were used successfully to identify key issues in palliative care. A total of 23 issues common to three or more countries informed decisions about the intervention and comparator of interest, sub questions and specific assessments within the health technology assessment. CONCLUSION: Stakeholders, including patients and families undergoing palliative care, can inform project decision making using various involvement methods according to the local context. Researchers should consider local understandings about stakeholder involvement as views of appropriate and feasible methods vary. Methods for stakeholder involvement, especially consultation, need further development.

The development of PubMed search strategies for patient preferences for treatment outcomes.

BACKGROUND: The importance of respecting patients' preferences when making treatment decisions is increasingly recognized. Efficiently retrieving papers from the scientific literature reporting on the presence and nature of such preferences can help to achieve this goal. The objective of this study was to create a search filter for PubMed to help retrieve evidence on patient preferences for treatment outcomes. METHODS: A total of 27 journals were hand-searched for articles on patient preferences for treatment outcomes published in 2011. Selected articles served as a reference set. To develop optimal search strategies to retrieve this set, all articles in the reference set were randomly split into a development and a validation set. MeSH-terms and keywords retrieved using PubReMiner were tested individually and as combinations in PubMed and evaluated for retrieval performance (e.g. sensitivity (Se) and specificity (Sp)). RESULTS: Of 8238 articles, 22 were considered to report empirical evidence on patient preferences for specific treatment outcomes. The best search filters reached Se of 100 % [95 % CI 100-100] with Sp of 95 % [94-95 %] and Sp of 97 % [97-98 %] with 75 % Se [74-76 %]. In the validation set these queries reached values of Se of 90 % [89-91 %] with Sp 94 % [93-95 %] and Se of 80 % [79-81 %] with Sp of 97 % [96-96 %], respectively. CONCLUSIONS: Narrow and broad search queries were developed which can help in retrieving literature on patient preferences for treatment outcomes. Identifying such evidence may in turn enhance the incorporation of patient preferences in clinical decision making and health technology assessment.

Complex health care interventions: Characteristics relevant for ethical analysis in health technology assessment.

Complexity entails methodological challenges in assessing health care interventions. In order to address these challenges, a series of characteristics of complexity have been identified in the Health Technology Assessment (HTA) literature. These characteristics are primarily identified and developed to facilitate effectiveness, safety, and cost-effectiveness analysis. However, ethics is also a constitutive part of HTA, and it is not given that the conceptions of complexity that appears relevant for effectiveness, safety, and cost-effectiveness analysis are also relevant and directly applicable for ethical analysis in HTA. The objective of this article is therefore to identify and elaborate a set of key characteristics of complex health care interventions relevant for addressing ethical aspects in HTA. We start by investigating the relevance of the characteristics of complex interventions, as defined in the HTA literature. Most aspects of complexity found to be important when assessing effectiveness, safety, and efficiency turn out also to be relevant when assessing ethical issues of a given health technology. However, the importance and relevance of the complexity characteristics may differ when addressing ethical issues rather than effectiveness. Moreover, the moral challenges of a health care intervention may themselves contribute to the complexity. After identifying and analysing existing conceptions of complexity, we synthesise a set of five key characteristics of complexity for addressing ethical aspects in HTA: 1) multiple and changing perspectives, 2) indeterminate phenomena, 3) uncertain causality, 4) unpredictable outcome, and 5) ethical complexity. This may serve as an analytic tool in addressing ethical issues in HTA of complex interventions.

Ethical analysis in HTA of complex health interventions.

BACKGROUND: In the field of health technology assessment (HTA), there are several approaches that can be used for ethical analysis. However, there is a scarcity of literature that critically evaluates and compares the strength and weaknesses of these approaches when they are applied in practice. In this paper, we analyse the applicability of some selected approaches for addressing ethical issues in HTA in the field of complex health interventions. Complex health interventions have been the focus of methodological attention in HTA. However, the potential methodological challenges for ethical analysis are as yet unknown. METHODS: Six of the most frequently described and applied ethical approaches in HTA were critically assessed against a set of five characteristics of complex health interventions: multiple and changing perspectives, indeterminate phenomena, uncertain causality, unpredictable outcomes, and ethical complexity. The assessments are based on literature and the authors' experiences of developing, applying and assessing the approaches. RESULTS: The Interactive, participatory HTA approach is by its nature and flexibility, applicable across most complexity characteristics. Wide Reflective Equilibrium is also flexible and its openness to different perspectives makes it better suited for complex health interventions than more rigid conventional approaches, such as Principlism and Casuistry. Approaches developed for HTA purposes are fairly applicable for complex health interventions, which one could expect because they include various ethical perspectives, such as the HTA Core Model® and the Socratic approach. CONCLUSION: This study shows how the applicability for addressing ethical issues in HTA of complex health interventions differs between the selected ethical approaches. Knowledge about these differences may be helpful when choosing and applying an approach for ethical analyses in HTA. We believe that the study contributes to increasing awareness and interest of the ethical aspects of complex health interventions in general.

Context and implementation: A concept analysis towards conceptual maturity.

Context and implementation of health interventions have received increasing attention over the past decade, in particular with respect to their influence on the effectiveness and reach of complex interventions. The underlying concepts are both considered partially mature, limiting their operationalization in research and practice. We conducted systematic literature searches and pragmatic utility (PU) concept analyses to provide a state-of-the-art assessment of the concepts of "context" and "implementation" in the health sciences to create a common understanding for their use within systematic reviews and HTA. We performed two separate searches, one for context (EMBASE, MEDLINE) and the other for implementation (Google Scholar) to identify relevant models, theories and frameworks. 17 publications on context and 35 articles on implementation met our inclusion criteria. PU concept analysis comprises three guiding principles: selection of the literature, organization and structuring of the literature, and asking analytic questions of the literature. Both concepts were analyzed according to four features of conceptual maturity, i.e., consensual definitions, clear characteristics, fully described preconditions and outcomes, and delineated boundaries. Context and implementation are highly intertwined, with both concepts influencing and interacting with each other. Context is defined as a set of characteristics and circumstances that surround the implementation effort. Implementation is conceptualized as a planned and deliberately initiated effort with the intention to put an intervention into practice. The concept of implementation presents largely consensual definitions and relatively well-defined boundaries, while distinguishing features, preconditions and outcomes are not yet fully articulated. In contrast, definitions of context vary widely, and boundaries with neighbouring concepts, such as setting and environment, are blurred; characteristics, preconditions and outcomes are ill-defined. Therefore, the maturity of both concepts should be further improved to facilitate operationalization in systematic reviews and HTAs.

Evaluation of ethical aspects in health technology assessment: more methods than applications?

Health technology assessment (HTA) emerged with the increased need for systematical evaluation of health technologies in the 1970s. From its very beginning, ethics was a constitutive part of HTA, and over the years a wide range of approaches have been suggested to address ethical aspects of health technologies. Despite a vast variety of methodologies in ethics, there is no consensus about the appropriateness of the existing methods. Moreover, while the available methods are many, their applications are few. While methods for addressing ethical issues in HTA have been richly reviewed, their applications are poorly tracked. Hence, a bottom up approach, that is, from practice to theory, may turn out to be as helpful as a top-down review. We need a review of the examples of ethics in HTA so we better can learn how the methods are used in practice, analyze the role of context, and better can assess the merits of the various methods.

Geographical variation in radiological services: a nationwide survey.

BACKGROUND: Geographical variation in health care services challenges the basic principle of fair allocation of health care resources. This study aimed to investigate geographical variation in the use of X-ray, CT, MRI and Ultrasound examinations in Norway, the contribution from public and private institutions, and the impact of accessibility and socioeconomic factors on variation in examination rates. METHODS: A nationwide survey of activity in all radiological institutions for the year 2002 was used to compare the rates per thousand of examinations in the counties. The data format was files/printouts where the examinations were recorded according to a code system. RESULTS: Overall rates per thousand of radiological examinations varied by a factor of 2.4. The use of MRI varied from 170 to 2, and CT from 216 to 56 examinations per 1000 inhabitants. Single MRI examinations (knee, cervical spine and head/brain) ranged high in variation, as did certain other spine examinations. For examination of specific organs, the counties' use of one modality was positively correlated with the use of other modalities. Private institutions accounted for 28% of all examinations, and tended towards performing a higher proportion of single examinations with high variability. Indicators of accessibility correlated positively to variation in examination rates, partly due to the figures from the county of Oslo. Correlations between examination rates and socioeconomic factors were also highly influenced by the figures from this county. CONCLUSION: The counties use of radiological services varied substantially, especially CT and MRI examinations. A likely cause of the variation is differences in accessibility. The coexistence of public and private institutions may be a source of variability, along with socioeconomic factors. The findings represent a challenge to the objective of equality in access to health care services, and indicate a potential for better allocation of overall health care resources.